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Abstract 

We establish uniform estimates for order statistics: Given a sequence of indepen- 
dent identically distributed random variables , . . . , ^„ with log-concave distribu- 
tion and scalars xi, . . . , Xn, for every k < nwe provide estimates for E k- mini<j<„ \xiS,i\ 
and Ek-maxi<j<n Ixj^il in terms of the value k and the appropriate Orlicz norm 
||(l/xi, . . . , l/xn)\\M, associated with the distribution function of the random vari- 
able 1^1 1 . For example, if is the standard A^(0, 1) Gaussian random variable, 

then the corresponding Orlicz function is M{s) = Jq e~2t^ dt. We would like 
to emphasize that our estimates do not depend on the length n of the sequence. 

1 Introduction 

In this paper we establish uniform estimates for order statistics. The k-th order statistic 
of a statistical sample of size n is equal to its k-th smallest value, or equivalently its 
{n — k + l)-th largest value. Order statistics are among the most fundamental tools in 
non-parametric statistics and inference and consequently there is extensive literature on 
order statistics. We only cite [1, 3, 5, 7, 11, 39] and references therein. 

Order statistics are more resilient to faulty sensor reading than max, min or average 
and thus they find applications when methods are needed to study configurations that 
take on a ranked order. To name only a few: Wireless networks, signal processing, image 
processing, compressed sensing, data reconstruction, learning theory and data mining. A 
sample of works done in this area are [2, 4, 6, 8, 9, 10, 12, 13, 17, 31, 33]. 

Order statistics on random sequences appear naturally in Banach space theory, in com- 
putations of various random parameters associated with the geometry of convex bodies 
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in high dimensions, in random matrix theory (computing the distribution of eigenvalues), 
and in approximation theory (see e.g. [15, 16, 17, 19, 22, 32, 36, 37, 38]). This hst of 
course does not include the enormous quantity of published works which deal with eval- 
uations and applications of max and min associated with various random parameters, 
e.g., smallest and largest eigenvalues of random matrices, as these are the extreme values 
in the scale of order statistics. 

For these important special cases of order statistics, the minimum and maximum 
value of a sample, very precise estimates were obtained in [18, 20, 21]. The new approach 
started there was to give estimates of the minimum and maximum value of the sample 

(1) E min \xi^i\ and E max |a;i^i|, 

l<i<n l<i<n 

in terms of Orlicz norms (see the definition below). The expressions for the estimate in 
case (1) are relatively simple. For instance, it was shown in [18] that 

Ci||a;||M < E max |a;j^i(a;)| < C2||a;||M, 

l<i<n 

and in [20, 21] that 

•^sfy^T^I < E min l^i^il < C4 f I , 

where Ci, C2, C3, and C4 are absolute positive constants and || • \\m is an Orlicz norm, 
depending on the distribution of ^1 only. In fact, in [18] much more general case was 
considered (see also [25] and [34]). 

Here we study the values 

(2) E /c- min \xi^i\ and Ek-max 

l<i<n l<i<n 

for general order statistics for i.i.d. (independent identically distributed) random vari- 
ables ^1, . . . , ^„ and scalars xi, . . . , x^, where for a given sequence of real numbers oi, . . . , a„ 
we denote the k-ih. smallest one by k- mini<j<„ a^. In particular, 1- mini<i<„ = mini<j<„ a. 
and n- mini<j<„ = maxi<j<„ a^. In the same way we denote the k-ih. biggest number 
by k- maxi<i<„ a;. Thus, k- maxi<j<„ ai = {n — k + 1)- mini<j<„ a^. In fact, in the theory 
of order statistics the standard notation for A;- min is au-.n- In this paper such a notation 
could be misleading and we prefer to use k- min. 

Now the expressions get more involved than in case (1). In view of possible appli- 
cations we strive to keep them as simple as possible - at the expense of the constants 
involved. We show that if ^1 has a log-concave distribution then for 1 < /c < n/2 

ci max II (IM)" . \\~\^^ < E fc- mm \xi^i\ < C2 max || (l/xi)"^^ Uli^^, 

l<j<k ■' k-j+i l<i<n l<J<k k-j+i 
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and ior 1 < k < cn 



C3 ( max \\{l/Xi)^^^f\\^ +\\{Xk+ck,---,Xn)\\M 



\Q<e<ck-l '~ 7+T 

< Ek-max \ xi^i\ 

l<i<n 

where A^, M are Orlicz functions (see the definitions below) and || • Hat, || • ||m are the 
corresponding Orhcz norms. The Orhcz functions A^, M are computed in terms of the 
distribution function of the random variables under consideration. The constants c, Ci, 
C2, C3, C4 depend - mildly - on the distribution function of the random variables and 
on k (of the order of Ink or 1/ln/c), but - and this is the important point - they do 
not depend in any way on the number n and on the scalars xi,...,Xn- The precise 
statements are given in Section 3. We would like to note that Orlicz functions appear 
naturally in the connection with log-concave distributions. For example in the important 
work of Gluskin and Kwapieh [14] Orlicz functions were used to obtain tail and moment 
estimates for sums of independent random variables. Recently, Latala [29] proved tail 
comparison theorem for log-concave vectors. 

In problems where only a small number of random variables is involved, numerical 
computations will give sufficient estimates for order statistics. However, in the case when 
a large number of random variables is involved, numerical computations may not be 
feasible. Our formulae allow easy computations also in that situation. 

Finally let us mention that throughout this paper we use the following notation. For 
a random variable ^ on a probability space (Q, 21, P) we denote its distribution function 
by and 1 - by 

G^it) = P ({e < t}) and F^{t) = P ({C > t}) . 

Acknowledgment. We would like to thank Hermann Konig, Kiel, for discussions. 



2 Preliminaries. Orlicz functions and norms. 

In this section we recall some facts about Orlicz functions and norms. For more details 
and other properties of Orlicz spaces we refer to [26, 30, 35]. 

A left continuous convex function M : [0, 00) — > [0, 00] is called Orlicz function or 
Young function, if M(0) = and if M is neither the function that is constant nor the 
function that takes the value at and is 00 elsewhere. The corresponding Orlicz norm 
on R"' is defined by 



(3) = inf < p > 



^M(|x,|/p)<l 



i=l 
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Note that the expression for || • ||m makes also sense if the function M is merely positive 
and increasing. Although in that case the expression need not be a norm, we keep the 
same notation || • ||m- We often use formula (3) in a slightly different form, namely 



l/lkllM = SUp<p>0 



Y,M{p \x,\)<l 



i=l 



Clearly, M < M implies ||-||m<||-||m- Moreover, if M is an Orlicz function and s > 1, 
then 

(4) sM{t) < M{st) 
for every t > 0. In particular, this implies 

(5) II • lIsM < s\\ ■ \\m- 

The dual function M* to an Orlicz function M is defined by 

M*(s) = sup {t-s-M{t)). 

0<t<oo 

For instance, for M{t) = ^ t'', g > 1, the dual function is M*{t) = ^ K with i + ^ = 1. 
Let the function p — pm '■ [0, oo) [0, oo] be given by 

r t^O 

p{t) = I M'{t) M(t) < oo 
( oo M{t) = oo, 

where M' is the left hand side derivative of M. Then p is increasing and the left hand 
side inverse q of the increasing function p is 

q{s) = mf{t e [0, oo) | p{t) > s}. 

Then 



M*{s) = f q{t)dt. 
Jo 



To a given random variable ^ we associate an Orlicz function M — in the following 
way: 

(6) M{s) = r [ \i\dFdt = [ {s\i\ - 1) dF. 

Jo J^<\^\ J^<\^\ 

The equality here follows by changing the order of integration and the convexity of M 
follows by the definition of convexity. We prefer to keep in mind both formulae for M. 
Note that equivalently one can write 

M(s)=E(5|e|-l), , 
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where, as usual, h+{x) denotes h{x) if h{x) > and otherwise. 

We claim that the dual function M* = M| is given on [0, / |^|(iP] by 



(7) 



M*( [ \^\dF] = m\>t) 



and M*{s) = oo for s > / \^\dF. 
Indeed, by definition 



M*(s) = sup{w ■ s - M(w)) ^ sup iw ■ s - [ [ \^\dFdu 
' Jo \ 



sup / s - / \^\d¥ I du. 
0<wJo \ Ji.<\^\ 



If s > J |^|(iP then the supremum is equal to oo. Now fix t > 0, set 

[ \^\dF 



and consider the function 



<P{w):^ £ Is- j^^ ICldFjdu. 



It is easy to see that is increasing on [0, 1/t] and decreasing on [1/t, oo). Therefore, 
M*{s) ^ sup (j){w) = (j){l/t) = f ^ f \^\dFdu. 

0<w Jo Jt<\£\<l/u 



Changing the order of integration we obtain 



/ / \i\dudF^ / dF^F{\i\>t), 
Jt<\£\ Jo Jt<\£\ 



M*{s) 
which proves (7). 

In the Gaussian case we have 

F(t)=P({|e|>t}) = Vf / 

and thus 



.2 



I — rS POO 2 j — /** 

(8) M{s)^Jl / / ue-'^dudt^sjl I e~^dt. 



'JO 



This implies that on the interval [0, ■\/2/7r] M* is given by 




For s > V^TT, M*{s) = oo. 



3 The main results 

Now we consider certain functions associated with a random variable ^ : — >■ M. 
The function F : [0, cxd) — > [0, cxd) is given by 

(9) F{t) = ¥m>t). 

We assume that F is strictly decreasing on [0, oo) and F(0) = 1. In particular, F is 
invertible. 

The function N : [0, oo) — >• [0, oo) is defined by 

(10) N{t) = In ^ 



m 

and is assumed to be convex. In particular, N is an Orlicz function. For such a function 
N and /c e N we put 

(11) Ar^- = ^-^7V, i = l,...,fc. 

Furthermore, let us observe that under assumptions above for alH > and all s > 1 
we have 

(12) F{st) < F{ty. 

Indeed, by (4) we have sN{t) < N(st), i.e. —slnF{t) < — In F{st), which is equivalent 
to (12). 

The following theorem generalizes results from [20, 21], where similar estimates were 
obtained for Gaussian distributions. Of course, the Gaussian case is simpler and the 
corresponding formulae are less involved. We discuss the details in Remark 1 after the 
theorem. 

Theorem 1 Let 1 < A; < | and let CiT--iCn be i.i.d. copies of a random variable 
^. Let F, N and Nj, j — l,...,k, be as specified in (9), (10) and (11). Then for all 
Q < Xi < X2 < ■ ■ ■ < Xn 

ci max II {l/xi)^- W^. < E /c- min \xi^i\ < 16e^ Cn ln(A; + 1) max || (l/x^)" ■ \\]^^., 

l<j<k ■' ^ l<i<n l<i<fc 

where ci = 1 - ^ and Cn = max{A^(l), 1/A^(1)}. 

Moreover, the lower estimate does not require the condition "N is an Orlicz function" . 



6 



Remark (the Gaussian case). In [20, 21] it was sliown tliat for iV(0, 1) random 
variables gi, i = 1, . . . ,n and for all < xi < 0:2 < • • • < Xn 

(13) Cn max < E /c- min IxiqA < 2-\/27r ln(k + 1) max 

where cq = ^1 — j ^ 1^1^. In Section 6 we show that the Gaussian distribution satisfies 

the conditions of Theorem 1. Thus the estimate (13) can be obtained from Theorem 1 
(with different absolute constants). 

Our second theorem provides bounds for expectations of k-max. As in Theorem 1 we 
assume that F is strictly decreasing, F(0) = 1, and that N — — In F is a convex function, 
where F is given by (9). Note that such a function F satisfies 

(14) £^^_|e,|^<(i + _L.),.^(,) 

for all positive t. We verify this. Since F — and N is convex 

/» POO POO 

/ \^i\dF^t- F{t) + / F{s)ds^t- F{t)+ / e-^^'Us. 
Using (4), we have N{s) > ^N{t) for s >t. Therefore 
/ 16 MP < t-F{t)+ /"e-f^Wds 

7t<iai Jt 



which implies (14). 



Theorem 2 Let Cit ■ ■ iCn be i.i.d. copies of a random variable 6 Let F, M, and N 



be as specified in (9), (6), and (10). Let 1 < k < n and ko 
k + ko < n. Then for all xi > X2 > • ■ • > Xn > 



4(fc-l) 
F{1) 



Assume that 



if ,. , -.k+in-i ln(8(/c — 1))\ ^ ... ... 

4 [o<f<^^-l ll(V^^)^=lll^iV+(^l+ ) ll(^'=+'=o,---,^n)||M 

< Ek-max \xi^i\ < c ( Cjvln(fc + 1) max || {l/xi)^^f \\~2l ^ + ||(a;fc+fco, • • ■,Xn)\\M J , 

l<i<n \ 0<«<feo— 1 e+i 

where Cn — max{A^(l), 1/A'"(1)}, and c is an absolute positive constant. 
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Remark. The case k = 1 was obtained in [18] (see also Lemma 11 below): Let 

M{s)= r f / (5Ki-i)dP. 

Then, for all a; e M" one has 

ci||a;||M < / max \xi^i{uj)\dF{uj) < C2||x||m, 

Jq l<i<n 

In particular, in the Gaussian case (8), 

M{s) = \[l I e'^dt. 
^ ^ Jo 

4 k-min 

We need the following two simple lemmas. Similar lemmas were used in [20, 21]. For the 
sake of completeness we provide the proofs. 

Lemma 3 Let < xi < X2 < ... < Xn- Let ^i,...,^„ be i. d. random variables. Let 
F{t) = P{|{i| > t} and G{t) = 1 - F{t). Then 



P I min \xiii\ <t\ <y^G {t/xi 

I l<i<n I ' 



Moreover, if the 's are independent then for every t > 



pjmin \xiii\ >t \ = \\F{t/xi) 

J 1=1 



Proof. Denote Ak{t) — {u \ \xkik{uj)\ > t} — {u \ |Cfe(<^)| > t/xk} and 

Ait) = {uj I min \xkW^)\ > t} = f) Ak{t). 

k<n ' ' 

k<n 

Then 

n n 

P {A{t)) > 1 - ^ P {Akity) ^1-J2g (t/xk) , 

k=l k=l 

which proves the first estimate. The second estimate is trivial. □ 
For the second lemma we need the following Proposition, proved in [20] . 
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Proposition 4 Let 1 < k < n. Let ai, i = 1, . . . ,n be nonnegative real numbers. Assume 



< a :— ^ tti < 1. 

rv 



1=1 



Then 



l=k Ac{l,2,...,n} ieA 
\A\=l 



< 



1 0/ 



V2TTk 1 - a' 



Lemma 5 Let 1 < k < n. Let < xi < X2 < ... < Xn and ^i, . . . ,Cn be i.i.d. random 
variables. Let G{t) = P{|^i| <t} and 



a = a{t) ^l^G (t/xi) . 



1=1 



Assume that t is such that < a < 1. Then 



(15) 



P<^ k- mill \x^^i\ <t} < 



l<i<n 



1 a* 



V27rk 



Remark. Note that if G is continuous and G{s) = if and only if s = then the 
condition on t in Lemma 5 above corresponds to the condition 

0<t<\\(l/x,)U\H, 

where H — |G. 

Proof of Lemma 5. We have 

F i uj k- min \xi£i(uj)\ < t 

l<i<n ' ^ ^ ^ I — 



...,ik>l: < 



yieA: \^i{u;)\ < — andVi ^ A : \^i{u;)\ > — 

Xi Xi 



u u 

(=k Ac{l,...,n 

\A\=e 

= E E E'f i«-Mis^}n'{ 

l=k Ac{i,...,n} ieA ^ * idA ^ 



M^)\>-\- 



It follows 



LO 



k-rninJxS(u;)\<t\ < H { 

J l=k Ac{l,.-,n} ieA ^ 

\A\=l 



UJ 



Xi 



l=k Ac{l,...,n} ieA 
\A\=l 



Proposition 4 implies the desired result. 



□ 



Lemma 6 Let H : ^ be an Orlicz function. For every k with 1 < k < n and 
every < Xi < X2 < ■ ■ ■ < Xn there is a partition of nonempty sets Ai, . . . ,Ak of the set 
{1, . . . ,n} such that 



(16) 



mm 



1=3 



< 4max{i/(l),l/i/(l)} mill 

l<j<k 



k-j+i 



H 



We want to emphasize that it is important that the partition consists of exactly 
k sets. Our proof shows that the partition can be taken as intervals, that is Aj — 
{rij + 1, . . . , rij+i} for an increasing sequence — Uq < rii < . . . < rik — n. 

Proof. We may assume that H{1) — 1. Indeed, as if is convex and as if(0) = 0, 
H{s) < IH{t) for aU < s < t Thus if H{1) < 1, then 



HimyW- < \\y\\H< 



H 



for every y e M". Similarly, if H{1) > 1 



« < lly|l^^ < H(i)\\y\\ H . 



We consider three cases. 
Case 1: 

(17) 



1 1 
— < - 
xi 4 



Note that H{1) = 1 implies t = 0, . . . , 0)||_ff for every i > 0, in particular \/xi = 
||(l/xi, 0, . . . , 0) \\h- We put no = and after having chosen no, . . . , < n we define 
ni+i < n to be the largest integer such that 



(18) 

We define 



Xi 



i=n(+l 



1 

< - 

- 2 



H 



Xi 



» / i=l 



-B^ = {n^_i + 1, . . . ,n^}, £=1,...,L. 

These sets are basically the partition we are looking for, except for a shght change that 
is necessary in order to get exactly k sets. 

We verify first that such a partition exists. For this we have to show that each 
contains at least one element, i.e. ^ 0. In other words, we show that = no < ni < 
. . . < n^ = n. Indeed, if n;_i < n, then n^_i + 1 G -B^ because 



> 



1 



> 



1 



X. 



0,...,0, 



1 



X 



-,0,...,0 



ne-1+1 



H 
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In the last equality we used again that H{1) = 1. Thus Bg ^ and til = n which means 
that the partition is well defined. 

We show now that L > k. By (18) for every e e (0, 1) and for £ = 0, . . . , L — 1 we 
have 



which implies 



Therefore 



Xi 



«/ 1=1 



1 

< - 

H- 2 

L 



1=1 



H Xi 
k 



H_ Xi 
k 



< 1, 



< L. 



Xi 



*/ i=l 



This implies L > k and below we use that the inequality is strict. 
We claim that for all £ = 1, . . . , A; one has 



(19) 



H 



1 

> - 

4 



»/ i=l 



Suppose that there is i with 1 < £ < k such that 



(20) 



«/ ieBp 



H 



1 

<4 



Since L > k > iwe have n^ + l <n. || • \\h is a norm. Therefore, by the triangle inequality 
and since H{1) = 1, 



Xi 



ne+1 















< 




+ 


( 


1+1 


H 




H 





0,...,0, 







H 


(iL 



+ 



1 



H 



By (17) and (20) 





1 








(^Ji=l 


1+1 


^2 

H 





This contradicts the definition of n^. 

Now we define the partition Ai, . . . , Ak- We put Ag = Bg iox 1 < £ < k — 1 and 



Ak = [jBg 



e=k 
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Then, by (19), 



min 

i<j<fc 











< 






H 






k-j+1 





(21) 

which proves (16). 
Case 2: 



< 4 min 

i<e<k 



< 4 min 

l<i<k 



H 



H 



1 1 

xi 4 



and for all j <k one has — > "'^ 



Xj 4 



1=3 



fc+l-i 



We choose Aj = {j} for j = 1, . . . , /c — 1 and Ai^ = {k, . . . , n}. Then for every j < k 







1 


1 








> — 












>4 





k+l-j 



which proves (16). 
Case 3: 



1 1 
xi 4 



1 



2/ i=l 



and there exists j < k such that — < 



Xj 4 



i=j 



H 



k+l-j 



Let m be the smallest integer such that m > 1 and 

1 



(22) 



1 1 

— < - 



Xn 



k+1- 



For 1 < £ < m we choose A^ = {£}. Then 







1 


1 


















Xf 

H 


=-4 





and therefore 



mm 

l<j<m 



1=3 



< 4 min 

l<j<m 



k-j+l 



k+l- 



H 



Now we consider the sequence < a;^ < a^m+i < ■ ■ • < and proceed as in Case 1. 
The assumption of Case 1 is fulfilled by (22). The procedure of Case 1 gives a partition 
A^, . . . , of {m, . . . , n} satisfying (21) 



4 min 

m<e<k 











> 











fc+1— m 
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This completes the proof. □ 

Lemma 7 Let p > 0, 1 < k < n, and < Xi < X2 < ... < Let C,i, ■ ■ ■ be i.i.d. 
random variables, F(t) = P ({|^i| > t}), N{t) = In and Nj = -^^j^N, j = 1, . . . , /c. 
Then ^ 

( ^ \^^°^ 

Proof. Let c = ( 1 — 1 . It is enough to show that for every k < n 

(23) c II (1/x,);Li 11^; < f^/c- min \xsA ■ 

Indeed, assume that (23) is true. Fix j < k. Since 

E k- min jxj^jj^ > E (/c — J ' + 1)- min jxj^ij^, 

l<i<n 

(23) implies 

^E k- ^mm jxiCij^^ > c II (IM)"^^. II^J, 

for all l<3 <k. 

Now we show estimate (23). Fix £ > small enough and put 

We use that 1 - i < - Ini for i > and that A^i = '^N = % In ^ and we obtain 

— ^ k K F 

n n 

a f J]G(A/x,) = f ^(l-F(^M)) 

i=l 1=1 



Applying Lemma 5, we get 



1 1 
P <j k- min jxiC/ >AP\>1 > 1 



as a < 1/2. This implies 

E k- min > A*' P | A;- min bi^J*' > A^'l > fl - A^. 

Sending £ to we obtain the desired result. □ 
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Lemma 8 Let p > and < xi < X2 < ... < Xn be real numbers. Let Ci) • • • > be i.i.d. 
random variables. Let F{t) = P(|Ci| > t) be strictly decreasing and N — — In. F be an 
Orlicz function. Then 

/I\n-P 



1=1 



2eN 



<E min \x < {1 + r{l + p)) 

l<i<n 



*/ i=l 



N 



Remark 1. If A'^ is an Orlicz function then by (5) 

(2e)-1 



-p <- II II -p 

W — ir ll2eAr- 



Remark 2. The left hand side inequality does not require the condition "N is an Orlicz 
function." 

Proof. The left hand inequality follows from Lemma 7. 
To prove the right hand side inequality we choose 



1 



Xi 



«/ i=l 



N 



Then for all t > to 



^ln(l/F {t'/yx,))>l. 



i=l 



By (12) for all t >to and all Xi 



{t/to)p In 1 < In 1 



F{tl/Xi) F{t^/xi) 



By Lemma 3, 



P s min \x. 

l<i<n 



}n In.. 
^n^(^'M)^exp -^In 
f=T ^ ^ \ 1^1 F[tyxi) 



and thus for all t >to 



P < min \xi6i\^ > t> < exp 

' l<i<n ' ' 1—1- 



1 1 
-{t/to)-pJ2^n—^^ ^ 

-1 F (t^JxA J 



< 



exp 



t \ p 
to. 



Therefore 



E min 

l<i<n 



= / P j min \xi^i\ yt^ldt 

Jo {l<i<n J 

= P I mm \xiCi\ >t^\dt+ I F{ min \xiCi\ > t" \ dt 



<to + 
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We substitute t = tos^, then 

POD 

E min \xi^i\P <to + toP / s^"^e~^ds < to (1 +pr(p)) , 

l<i<n 

which completes the proof. 



□ 



Lemma 9 Let 1 < k < n and < xi < X2 < ■■■ < Xn- Let Ci) • • • )Cn i.i.d. random 
variables. Let F{t) — P(|Ci| > t) be strictly decreasing, and let N — — In. F be an Orlicz 
function. Let Mj = N/(k - j + 1), j ^ 1, . . . ,k. Then 

E k- min Ixi^A < 8eln(/c + 1) Cn max 11 \Kj 

l<i<n ^ ' l<j<k /i-j nivij 

where Cn = max{N{l), 1/N{1)}. 



Proof. The case k — 1 follows form Lemma 8. We assume k >2. 

Let Ai, . . .Ak be the partition of {1 . . .n} given by Lemma 6. Then for all > 1 



E k- min < E max min Ixj^A < E ( > 

i<i<n' ^ ' - i<j<kiGAj^ - 

\j=i 



min \xS, 



1 

q\ 1 



min \xi^i 



\ i=i 

By Lemma 8 the latter expression is less than 

k 



1 

q\ q 



EE 



m.in\xi^i 



1 

q\ q 



(i + r(i + g))^ (^) 

The choice q — \n{k-\-l) gives 



1 

q\ q 



N 



< 2qk^/'i max 



AT 



E k- min < 2eln(A; + 1) max 

l<i<n l<j<*; 



By Lemma 6 this expression is smaller than 

8e Cn max 



Xi 



N 



l<j<k 



1=3 



Mi 



□ 



Proof of Theorem 1. The lower estimate follows from Lemma 7. Since, by (5), 

II • Ikj 

the upper estimate follows by Lemma 9. 



• U",- < 2e • \\M. 



J' 



□ 
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5 k-max 

In this section we prove Theorem 2. We require a result from [18]. Let / be a random 
variable with continuous distribution and such that E|/| < oo. Let i„ = tn{f) — 0, 
^0 — toif) = and for j = 1, . . . , n — 1 

(24) tj = tj{f) = sup {t I ¥{u;\ \f{u;)\ > t} > ^} . 
Since / has the continuous distribution, we have for every j > 1 

P{u;| \f{u;)\>tj}^i. 

For j = 1, . . . ,n define the sets 

(25) = Qjif) = {u;\ < \f{u;)\ < 
For all J = 1, . . . , n we have 

^- = {^1 tj < \f{u;)\ < = {u;\ tj < \f{u;)\} \ {u;\ < \f{u;)\}. 

Therefore 

P(Q .) = i _ ini = i. 

\ J ' n n n 

For J = 1, . . . , n let 

(26) %■ = %■(/):= / l/(^)l^(^)- 
Then 

n 

yj — E|/| and tj < nyj < tj^i for all j — 1, . . . , n. 

In [18], Corollary 2 we proved the following statement. 

Lemma 10 Let /i, . . . , /„ be i.i.d. random variables such that J \ fi{ou)\dP{u}) — 1. Let 
M be an Orlicz function such that for all k = 1, . . . , n 

Then, for all x e R" 

Ci||a:;||M < / max \xifi{uj)\d¥{uj) < C2||x||m, 
where ci and C2 are absolute positive constants. 
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This can be reformulated in the following way. 

Lemma 11 Let ^i, . . . be i.i.d. random variables such that J \^i{u!)\dF{u!) — 1. Let 
M be the Orlicz function such that for all s > 

Mis) = r [ \i,\dFdt = / {s\C\ - 1) dF. 

Jo 7i<iai J^m 



Then, for all x 



ci||a;||M < / max |a;i^i(ci;)|(iP(cc;) < C2||a;||M, 



where ci and C2 are absolute positive constants. 
Proof. By definition 



(a;) I dF{uj) 

i=i Jtk<e.i 

and 



P({a; I tk<U^)})^-. 



Therefore the Orlicz function M* defined by 



MM / \Uuj)\dn^) \ =¥{uj\t<\Uuj)\} 
\Jt<\^i\ J 

satisfies the condition of Lemma 10. It is left to observe that the dual function to M* is 



M{s) ^11 \Ci\dFdt. 

Jo ii<l£il 



'0 Ji<|6l 

This has been verified in Section 2 (see formulae (6) and (7)). □ 

For the next lemma we need the following simple claim. 

Claim 12 Let {xiYl^^ ^ sequence. Then for every j < n — k one has 

k-max|xj| < j-min + max \xi\. 

l<i<n i<j<fc_|_j_i k+j<i<n 

Proof. If the numbers |xi | , . . . , |a;fc+j_i | contain the k biggest of the numbers |a;i | , . . . , |a;n | , 
then 

j-min = k-max l^jj = k-max 

l<i<k+j-l l<i<k+j-l l<i<n 
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On the other hand, if the numbers . . . , |a;fc+j_i| do not contain the k biggest of the 
numbers |a;i|, . . . , \xn\, then at least one of those is contained in the numbers . . . , |a;n| 



and therefore 



max > k-max 

k+j<i<n l<i<n 



□ 



Lemma 13 Let xi > X2 > ■ ■ ■ > Xn > 0. Let ^i, . . . be i.i.d. random variables and 
F{t) — P({|^i| > t}). Suppose that F is strictly decreasing and N — — InF is an Orlicz 
function. Assume that M is the Orlicz function such that for all s >0 



M{s) \^\dfdt. 

Jo Ji<|^| 



Then we have 
E 



k-max|xi^i| <c min jCjv ln(A; + l) max || (l/xi)^^^/ ||^ + . . . , x„)||m|, 



where c is an absolute constant and Cn = max{A^(l), 1/A^(1)}. 
Proof. Claim 12 implies 



Ek-max l^i^jl < min IE j-min pi^jj+E max \xi^i 

l<i<n l<j<n—k y l<i<fe+;; — 1 k+j<i<n 

Applying Theorem 1 to the sequence Xk+j-i < Xk+j-2 < • • • < a^i, we observe that 
E j-min |a;i^i| < IGc^Cat ln(A; + 1) max || (IM)^^/"^ H " L ^- 

l<i<k+j-l i<e<j j-e+i 

This is the same as 



; j-min < 16e^Civln(A; -Fl) max || (lM),ti^ H^^,- 

l<i<k+j-i o<i<j-i e+i^" 



On the other hand, Lemma 11 implies 

E max \xi^i\ <c\\{xk+j,...,Xn)\\M, 

k+j<i<n 

where c is an absolute constant. This completes the proof. □ 



Lemma 14 Let xi > X2 > ■ ■ ■ > Xn > 0- Let Cit ■ ■ ^Cn be i.i.d. random variables and 
F{t) = P(|Ci| > t). Fork>l let 



A{k - I) 
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Then 



Ek-max\xS\>max<-\\{xk,...,Xn)\\NFk: max E £-min \xi^i\ 
l<i<n ' ' [2 ' /II F,k^ l<e<n-k i<i<k+e-i 

In particular, if N{t) — In -p^, then 

Ek-max \xiCi\ > max | ^ . . . , x„)||jv^ (1 - max || lllk 



Proof. First we show 



Ek-max \xi^i\ > - \\{xk, . . . ,x, 



l<i<n 



n 



We have 



k-l 



k-maxi..6Mi<<hE E n^(|)n 1-^(1 

j=0 Ac{l,...n} ieA ^ *^ i^A ^ ^ * 



1-41=3 



Since xi > X2 > ■ ■ ■ > Xn > and \A'^\ > n — k + 1, we observe 



Now we apply the Hardy-Littlewood-Polya inequahty ([23]), which states that for non- 
negative numbers oi, . . . , one has 



Ac{l,.-m} i^A 



,i=l 



This imphes 



k-max \xi^i( 

l<i<n 



Since F < 1 and 1 — x < e~^ for a; > 0, one has 



Let 



k-max \xi 

l<i<n 



a 



i=k ^ ' 



19 



Then 



k-max |a;j^j(ci;)| < t 

l<i<n 



j=0 ^' 

k—1 



-a(fc-l). 



j=0 " 

= exp {{k - 1) {-a + 1 + In (1 + a))) . 



Now put 



to := \\{xk, . . . 



N 



F,k 



> 0. 



If to = we are done. If to > then for every < e < to 



Since k > 1, this implies 



k-meix\xi^i{u;)\ < to - e > < exp((A; - l)(-3 + ln5)) < 1/2. 

l<i<n 



Thus 



E k-max \xi^i\ > {to — e) P < a; 

l<i<n 



k-max \xi^i{uj)\ > to - e )■ > ^° ^ ^ . 

l<i<n I ^ 



Letting e tend to we obtain the first part of the desired estimate. 

Now we show the second part of the estimate. We observe that for alH < n — /c -|- 1 



This implies 



£-min \xiEi(u!) \ = k-max IxiEiiuj) 
i<i<k+e-i ' ^ ^ ^ ' i<i<k+e-i I ^ ^ ^ 



E k-max Ixjfjl > max E £-min Ixjfj 

l<i<n l<^<n-fc-|-l l<i<fc-|-^-l 



Finally, the "In particular" part of Lemma 14 follows from Lemma 7. Note that in 
Lemma 7 the sequence x is in increasing order while in Lemma 14 it is in decreasing 
order. □ 



In the next lemma we provide a lower estimate on || • Wnp^i appearing in Lemma 14. 

Lemma 15 Let 1 < k < n. Let Ci^-'-jCn be symmetric i.i.d. random variables with 
j \^i{uj)\dF{uj) = 1. Let F{t) = Pd^Cil > t) be a strictly decreasing function such that 
N = — In F is an Orlicz function. Let M be the Orlicz function defined by 




^i\dFdt. 
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Let 



4(A;- 1)' 



Let kt] 



4{fc-l) 



and assume that k + ko < n. Then for all Xi > ■ ■ ■ > Xn > 



F{1) 

\\{Xk+ko, ■ ■ ■,Xn)\\M < 



^ ln(8(fc-l))\ 



Remark. The condition N = —In F is an Orlicz function in this Lemma can be 
substituted with the condition there is a constant C2 > 1 such that for all s e (0, 1/C2] 
and t e (0, l/(4c|)] 

(27) F-\s)F-\t) > F-\c2st) 
and such that for all t > F~^{-^) we have 

(28) / \^i\dF<C2tF{t). 

Jt<|6| 



Then the conclusion will be 

\\{Xk+ko,---,Xn)\\M < F~^{a) \\{Xk,...,Xn)\\Np,k^ 

where a = l/(4c|(A; - 1)). 

Proof. Since both functions || • \\m and || • Wnp^ are homogeneous, we may assume 

that ||(a;fc_|_fc„, . . . , ,t„)||m = 1- Thus, without loss of generality, wc can assume that 
Yl^=k+ko ^i^i) — 1 (otherwise we pass from the sequence {xjjj to {xi/{l + e)}i for an 
suitably small s > 0). 
We put 

^-^ - ^ + N{1) ■ 
Note that by (4), N(A) > AN(1) > InS > 2. 
Case 1: Xk+ko > IM- Then Xk > Xk+i > . . > Xk+ko > IM- 
Since F is a decreasing function, 1/F~^ is increasing and 

n fc+fco 

J2 F {(xiA)-') >J2f ii^^^r') > (ko + 1)F(1) > A{k - 1). 

i=k i=k 

This means that 

\\{Xk,...,Xn)\\Np^, > 1/A. 

Case 2: Xk+ko < IM- Then 1/A > Xk+ko > ■ ■ ■ > Xn- 
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Since /i<|^^| iCiM^P is an increasing function of t, we observe 



M(s) = / / \^i\dFdt < s / 1^1 |dP. 
Jo Ji<|6l Ji<iei| 

By (14), applied with t = 1/s, we obtain that for all positive s 

Recall that N is increasing and N{A) > 2. Thus for all s < 1/A we have 

M{s) <s [ < 2 F{l/s). 

By the condition of Case 2, Xi < l/Aior i > k + ko. This imphes 

n " / 1 \ 

(29) 1= y: ^(^^)^2 y: 

i=k+ko i=k+ko ^ 

Now, by (4), we have N(y) > (3N(y/(3) for every y > and /3 > 1. Since = - In F, 
we observe 

F{y) < F{y/Pf 
for every y > and /3 > 1. Since F is decreasing, it implies 

Fiy) < Fiy/P) F{lf-' 

for every y > P > 1. Applying the last inequality with y — 1/xi and = A, we obtain 
for every i > k + ko 

F{l/x,) < F{l/{Ax,)) F{l)^-\ 

By (29), 

n ^ n ^ 

E ^ (1/(^-0) > JT^ E P > ^J?7^- 

i=k ^ ' i=k+ko ^ ' 



Now, by the choice of A, 



and hence 



_ ln(8(fc - 1)) 
ln(l/F(l)) ' 

1 



2F(1)^-^ = 



Thus, 



4(A;- 1) 



i=k 
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which imphes 

It completes the proof. 



\\{Xk,...,Xn)\\Np. > l/A. 



□ 



Now we prove Theorem 2. 

Proof of Theorem 2. Let ko 

With j — ko in Lemma 13 



4(fc-l) 



First we show the right hand side inequahty. 



E 



k-max|a;i^i| < c min i Cjv ln(A; + 1) max \\ {l/xif^^f \\ 2I \\{xk+j, ■ ■ ■ ,Xn)\\M\ ■ 

l<t<n l<j<n—k K 0<£<j—l e+i^^ ) 



l<j<n-k K ~ ' 0<^<j-l • - 7+1^ 

To show the left hand side inequality we apply Lemma 14 with I — ko: 



E 



k+ko-j 11-1 



By Lemma 15 we have for all x with Xi > ■ ■ ■ > Xn > 

||(a;fe+fco) • • • )2;„)||m < A \\{xk, ■ ■ ■ ,Xn)\\NF^k^ 
where A=l + »j^. Thus 



E 



k-maxIxiCil > ^\\ixk+ko,---,Xn)\\M + l[l-;^) max II (l/x,)^i* 



k+ko-j 11-1 



1 1 

Xk+koj • • • ) ^n) \\m + ~ I 1 7S 



4A 



k+e II -1 



N 



II / 1 / \K+<: II —1 
2-^/ 0<^<A;o-l FFT-'^ 



□ 



6 The Gaussian case 

In this section we verify that Gaussian A^(0, l)-variables satisfy the hypotheses of The- 
orems 1 and 2. Hence in this section we consider only standard Gaussian variables and 
we denote them by ^. Accordingly, 



for t > and iV = In |; = — In F. We check the properties of the functions F and in 
several claims. 
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Claim 16 For every t > and ^4 > 

I— roc 2 /— \ f 

(30) F{t) = e-'rds < - exp (^-- 

and 



(31) A exp(-(t + A)V2) <F(i). 
In particular, for A—l/t 

(32) 1 e^p{-{t' + l/t')/2)<F{t). 



Proof. Both estimates follow immediately by integration. Indeed, the upper estimate 
follows from 

f°° _£ _£ _*i 

t e '2 ds < se '2 ds — e "2 , 

while the lower estimate follows from 

/oo 2 rt+A 2 

e~'^ds>J e~'^ds>Aexp{-{t + Af/2). 

□ 



Claim 17 N is an Orlicz function. 



Proof. N is an increasing function on [0, oo) such that N{t) = if and only if t — 0. 
We have to show that N is convex. To do so, we show that N"{t) > for i > 0. 

e~V ^e~V — t f^ e^^dsj 

which is non-negative by (30). □ 

Claim 17 shows that F and N satisfy the hypothesis of Theorem 1 and 2. Next we 
estimate the Orlicz norm Nj. 

Claim 18 Let N = -lnF, 




for 0<t<l 
for t > 1. 
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Then H is an Orlicz function and for every t > 

(27re)"^/^ H{t) < N(t) < 4.5 H(t). 
In particular, if k <n and Nj, j < k, as in (11) then for every t >0 

/Tp 1 Qp 
- 1 — r H{t) < Nj{t) < — - H{t). 

Proof. Clearly, H is an Orlicz function. 
For every <t < i/tt/S we have 

l<l-.ftt< F(t) = l-xft te-^ds <l-\[^t. 



Since (x — l)/2 < Inx < a; — 1 on [1, 2], we observe for < i < ^/njs 



11. 1 



t 



N(t) = In -f- < -f- - 1 < - 1 < " " < J^t 

m~m ~i-,fit ~i-,fit~ 



and 



F(t)-2\F(t) /"2lj /T( - V2^' 

\ y eTT / 

This shows the desired result for < t < a/vt/S. 

Consider now the function f{t) = N{t) — 1'^/2 and observe that /(O) = 0. By (30) we 
have f'{t) > for i > 0. Thus, for every t > one has N{t) > 

Finally, applying (31) with A — y^7r/2, we have for t > a/tt/S (then t + A < 3t) that 

F{t) > exp (-9^72) . 

This implies < N{t) < 9t^/2 for t > v^tt/S. In particular, H/V^tw <N< 9H/2. 
□ 
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